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(54) Method and apparatus for Image distortion correction 



(57) The present invention provides an image dis- 
tortion correction apparatus comprising a circumscribed 
rectangle extraction unit which extracts a circumscribed 
rectangle for each character in a distorted image 
scanned by an image reading unit to read an original 
placed on a reference plane, a character string extrac- 
tion unit which extracts character strings using said cir- 



cumscribed rectangles extracted by said circumscribed 
rectangle extraction unit, a distance estimation unit 
which estimates a distance between said reference 
plane and said original using said character strings and 
an image distortion correction unit which corrects said 
distorted image based on said distance between said 
reference plane and said original estimated by said im- 
age distortion correction unit. 
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Description 

[0001] The present invention generally relates to an 
Image processing-apparatus, and more particularly to 
an image distortion correction apparatus, an image dis- 
tortion correction method therefor, recording media, an 
image scanner and an image construction apparatus, in 
which a distorted part of a scanned image is corrected. 
[0002] When a book type original, for example, a book 
or a booklet, is copied or scanned, it is hard to keep a 
binding part of the book on a focus plane of a copier or 
a scanner. The binding part of the book type original is 
separated from the focus plane of a copier or a scanner. 
This causes a copied or scanned image to be distorted 
and sharpness of characters on the copied or scanned 
image is reduced. The distorted part of the copied or 
scanned image is hard to read and, furthermore, a char- 
acter recognition rate of an OCR (optical character read- 
er) becomes very low. Above all, the thicker the book is, 
the harder it is to read the copied or scanned image. On 
the other hand, if the book is pressed to the focus plane, 
the book may be damaged. 

[0003] To address tWs problem, therefore, a method 
to correct a distorted image has been proposed , in which 
method a three dimensional shape of an object is esti- 
mated based on density information of the image. An 
example of that method is described in a publication of 
T.Wada, H.Uchida and T.Matuyama, " Shape from 
Shading with Interreflection under a Proximal Light 
Source: Distortion- Free Copying of an Unfolded Book", 
International Journal Computer Vision 24(2), 125-135 
(1 997) and the representative method of shape from 
shading is further described in a publication of Hiroyuki 
Uklta and Katsunobu Konishl, Three dimensional 
shape recovery for a booklet surface using intrinsic 
space method", IECE technical report, PRMU99-91 , pp. 
23-30, Oct., 1999. 

[0004] Further, a method is proposed in the laid-open 
Japanese patent application number 1 1 -41 455, in which 
method a three dimensional shape of an object is esti- 
mated based on an outline of a scanned image, 
[0005] However, it is hard to put the method called the 
shape from shading into practical use because the 
method requires significant computational steps, and 
therefore requires a computational time of long duration. 
[0006] On the other hand, a method described in the 
laid-open Japanese patent application number 
11-41455 only requires a few computational steps to 
correct the distorted image, however, It is difficult to suf- 
ficiently correct the distorted image using this method 
when the whole outline of the booklet is not fully cap- 
tured. 

[0007] It is a general object of the present invention 
to provide an image distortion correction apparatus, 
which is able to correct a distorted image and requires 
a few computational steps even if the whole outline of a 
booklet is not fully captured: 

[0008] The above objects of the present invention are 



achieved by an image distortion correction apparatus 
comprising; 

a circumscribed rectangle extraction unit which ex- 
s tracts a circumscribed rectangle for each character 
in a distorted image scanned by an image reading 
unit from an original book placed on a reference 
plane; 

a character string extraction unit which extracts 
10 character strings using the circumscribed rectan- 
gles extracted by the circumscribed rectangle ex- 
traction unit; 

a distance estimation unit which estimates a dis- 
tance between the reference plane and the original 
15 book containing the character strings; and 

an image distortion correction unit which corrects 
the distorted image based on the distance between 
the reference plane and the original estimated by 
the image distortion correction unit. 

[0009] According to the invention, the character 
strings are extracted from the scanned image read by 
an image reading unit. Then, a three dimensional shape 
(including a distance between the reference plane and 
the original) of the original, estimated based on the char- 
acter strings and the image distortion, is corrected. As 
a result, even if the whole outline of the booklet is not 
fully captured, it is possible to sufficiently correct the dis- 
torted image with a few computational steps according 
to the present invention. 

[0010] The above objects of the present invention are 
achieved by the image distortion correction apparatus 
further comprising: 

an original distinction unit, which decides whether 
the original is written horizontally or vertically, and 
in case wherein the original distinction unit decides 
that the original is written in the horizontal, 
the distance estimation unit first selects character 
strings each of which has a length longer than a 
length equal to a predetermined ratio multiplied by 
the length of the longest string out of a plurality of 
character strings in the distorted image, then, se- 
lects one string having the largest curvature out of 
the selected character strings for a reference char- 
acter string, and then, estimates a distance be- 
tween the reference plane and the original using the 
reference character string. 

[0011] According to the invention, it is possible to se- 
lect a reference character string so that the distance be- 
tween the reference plane and the original can be ade- 
quately estimated. 

[0012] The above objects of the present invention are 
achieved by the image distortion correction apparatus, 
wherein the curvature is measured based on a location 
of center coordinates in a main scanning direction of the 
circumscribed rectangles in the character string, and the 
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larger a difference between a maximum value of the 
center coordinates and a minimum value of the center 
coordinates, the larger is the curvature. 
[001 3] According to the present invention, it is possi- 
ble to select the string having the largest curvature. s 
[001 4] The above objects of the present invention are 
achieved by the image distortion correction apparatus 
further comprising: 

an original distinction unit which decides whether io 
the original is written horizontally or vertically, andin 
case wherein the original distinction unit decides 
that the original is written in the vertical, 
the character string extraction unit extracts a refer- 
ence character string using circumscribed rectan- 15 
gles either at a top of or at a bottom of each vertical 
line, 

the distance estimation unit estimates a distance 
between the reference plane and the original using- 
the reference string. 20 

[001 5] According to the invention, it is possible to se- 
lect a reference character string so that the distance be- 
tween the reference plane and the original can be ade- 
quately estimated. 25 
[001 6] The above objects of the present invention are 
achieved by the image distortion correction apparatus, 
wherein 

the distance estimation unit measures both a first 
distance D1 between a prolonged line of a straight line 30 
part in the reference character string and a curve part 
in the reference character string and a second distance 
D2 between an imaging center straight line and the 
curve part In the reference character string, and esti- 
mates a distance D between the reference plane and 35 
the original based on 

D = RX (D1 /D2) 

40 

, where R is a distance between the reference plane and 
a center of a lens, 

[0017] According to the present invention, the distor- 
tion is adequately measured and the three djmensional 
shape is properly estimated. 45 
[001 8] The above objects of the present invention are 
achieved by the image distortion correction apparatus, 
wherein 

the distance estimation unit independently esti- 
mates each distance between the reference plane and so 
the original for a left page and a right page. 
[0019] According to the present invention, in a case 
that each distance between the reference plane and the 
original for a left page and a right page has different val- 
ue because, for example, the pages near the first or last ss 
page of the original are copied, each distance is inde- 
pendently estimated so that the distortion for each page 
is properly corrected. 



an image distortion correction apparatus compris- 
ing: 

a ruled line extraction unit which extracts ruled lines 
in a distorted image scanned by an image reading 
unit to read an original placed on a reference plane; 
a distance estimation unit which estimates a dis- 
tance between the reference plane and the original 
using the ruled lines; and 

an image distortion correction unit which corrects 
the distorted image based on the distance between 
the reference plane and the original estimated by 
the image distortion correction unit. 

[0020] According to the present invention, the ruled 
lines are extracted from the scanned image read by an 
image reading unit. Then, a three dimensional shape 
(incorporating a distance between the reference plane 
and the original) of the original is estimated based on 
the ruled lines and the image distortion is corrected 
based on the estimated three dimensional shape of the 
original. As a result, even if the whole outline of the book- 
let is not fully captured, it is possible to sufficiently cor- 
rect the distorted image with a few computational steps 
according to the present invention. 
[0021] The above objects of the present invention are 
achieved by the image distortion correction apparatus 
further comprising: 

an original distinction unit which decides whether 
the original is written horizontally or vertically, 
wherein in case that the original distinction unit de- 
cides that the original is written in the horizontal, 
the distance estimation unit first, selects ruled lines 
each of which has a length longer than a length of 
a predetermined ratio to that of the longest ruled line 
out of a plurality of ruled lines in the distorted image, 
then, selects one ruled line placed nearest an upper 
edge or a lower edge of the scanned image out of 
the selected ruled lines for a reference ruled line, 
and then, estimates a distance between the refer- 
ence plane and the original using the reference 
ruled line. 

[0022] According to the present invention, it is possi- 
ble to select an adequate ruled line string so that the 
distance between the reference plane and the original 
is adequately estimated. 

[0023] The above objects of the present invention are 
achieved by the image distortion correction apparatus, 
wherein 

the distance estimation unit measures both a first 
distance D1 between a prolonged line of a line part in 
the reference ruled line and a curve part in the reference 
ruled line and a second distance D2 between an imaging 
center line and the curve part in the reference ruled line, 
and estimates a distance D between the reference plane 
and the original based on 
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D = R x (D1 / D2) 

, where R is a distance between the reference plane and 
a center of a lens. 5 
[0024] According to the present invention, the distor- 
tion is adequately measured and the three dimensional 
shape is properly estimated. 

[0025] The above objects of the present invention are 
achieved by the image distortion correction apparatus, 10 
wherein 

the distance estimation unit independently esti- 
mates each distance between the reference plane and 
the original for a left page and a right page. 
[0026] According to the present invention, in case that 15 
each distance between the reference plane and the orig- 
inal for a left page and a right page has different value 
because, for example, the pages near the first or last 
page of the original are copied, each distance is inde- 
pendently estimated so that the distortion for each page 20 
is properly corrected. 

[0027] The above objects of the present invention are 
achieved by a computer readable recording media hav- 
ing a program to execute an image distorti on correction , 
method, the program comprising steps of: 25 

a circumscribed rectangle extraction step for ex- 
tracting a circumscribed rectangle for each charac- 
ter in a distorted image scanned by an image read- 
ing step to read an original placed on a reference 30 
plane; 

a character string extraction step for extracting 
character strings using the circumscribed rectan- 
gles extracted by the circumscribed rectangle ex- 
traction step; 35 
a distance estimation step for estimating a distance 
between the reference plane and the original using 
the character strings; and 

an image distortion correction step for correcting 
the distorted image based on the distance between *o 
the reference plane and the original estimated by 
the image distortion correction step. 

[0028] According to the present invention, the char- 
acter strings are extracted from the scanned image read 45 
by an image reading unit. Then, a three dimensional 
shape (a distance between the reference plane and the 
original) of the original is estimated based on the char- 
acter strings and the image distortion is corrected based 
on the three dimensional shape of the original. As a re- so 
suit, even if the whole outline of the booklet is not fully 
captured, it is possible to sufficiently correct the distort- 
ed image with a few computational steps according to 
the present invention. 

[0029] The above objects of the present invention are ss 
achieved by the computer readable recording media fur- 
ther comprising: 



an original distinction step which decides whether 
the original is written horizontally or vertically, 
wherein in case that the original distinction unit de- 
cides that the original is written in the horizontal, 
the distance estimation step first, selects character 
strings each of which has a length longer than a 
length of a predetermined ratio to that of the longest 
string out of a plurality of character strings in the 
distorted image, then, selects one string having the 
largest curvature out of the selected character 
strings for a reference character string, and then, 
estimates a distance between the reference plane 
and the original using the reference string. 

[0030] According to the present invention, it is possi- 
ble to select an adequate reference character string so 
that the distance between the reference plane and the 
original is adequately estimated. 
[0031 ] The above objects of the present invention are 
achieved by the computer readable recording media, 
wherein the curvature is measured based on a location 
of a center coordinates in a main scanning direction of 
the circumscribed rectangle in the character string, and 
the larger a differen ce b etween a maximum value of the 
center coordinates and a minimum value of the center 
coordinates, the larger the curvature is. 
[0032] According to the present invention, it is possi- 
ble to select the string having the largest curvature. 
[0033] The above objects of the present invention are 
achieved by the computer readable recording media fur- 
ther comprising: 

an original distinction step for deciding whether the 
original is written horizontally or vertically, wherein 
in case that the original distinction unit decides that 
the original is written in the vertical, 
the character string extraction step extracts a refer- 
ence character string using circumscribed rectan- 
gles either at a top of or at a bottom of each vertical 
line, 

the distance estimation step estimates a distance 
between the reference plane and the original using 
the reference string. 

[0034] According to the present invention, it is possi- 
ble to select an adequate reference character string so. 
that the distance between the reference plane and the 
original is adequately estimated. 
[0035] The above objects of the present invention are 
achieved by the computer readable recording media, 
wherein 

the distance estimation step measures both a first 
distance D1 between a prolonged line of a line part in 
the reference character string and a curve part in the 
reference character string and a second distance D2 be- 
tween an imaging center line and the curve part in the 
reference character string, and estimates a distance D 
between the reference plane and the original based on 
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D = R X (D1 / D2) 

, where R is a distance between the reference plane and 
a center of a lens. 

[0036] According to the present invention, the distor- 
tion is adequately measured and the three dimensional 
shape is properly estimated. 

[0037] The above objects of the present invention are 
achieved by the computer readable recording media, 
wherein 

the distance estimation step independently esti- 
mates each distance between the reference plane and 
the original for a left page and a right page, 
[0038] According to the present invention, in case that 
each distance between the reference plane and the orig- 
inal for a left page and a right page has different value 
because, for example, the pages near the first or last 
page of the original are copied, each distance is inde- 
pendently estimated so that the distortion for each page 
is properly corrected. 

[0039] The above objects of the present invention are 
achieved by a computer readable recording media hav- 
ing a program to execute an image distortion correction 
method, the program comprising steps of : 

a ruled line extraction step for extracting ruled lines 
in a distorted image scanned by an image reading 
unit to read an original placed on a reference plane; 
a distance estimation step for estimating a distance 
between the reference plane and the original using 
the ruled lines; and 

an Image distortion correction step for correcting 
the distorted image based on the distance between 
the reference plane and the original estimated by 
the image distortion correction step. 

[0040] According to the present invention, the ruled 
lines are extracted from the scanned image read by an 
image reading unit. Then, a three dimensional shape (a 
distance between the reference plane and the original) 
of the original is estimated based on the ruled lines and 
the image distortion is corrected based on the three di- 
mensional shape of the original. As a result, even if the 
whole outline of the booklet is not fully captured, it is 
possible to sufficiently correct the distorted image with 
a few computational steps according to the present in- 
vention. 

[0041 ] The above objects of the present invention are 
achieved by the computer readable recording media fur- 
ther comprising: 

an original distinction step for deciding whether the 
original is written horizontally or vertically, wherein 
in case that the original distinction unit decides that 
the original is written in the horizontal, 
the distance estimation step first, selects ruled lines 
each of which has a length longer than a length of 



a predetermined ratio to that of the longest ruled line 
out of a plurality of ruled lines in the distorted image, 
then, selects one ruled line placed nearest an upper 
edge or an lower edge of the scanned image out of . 
5 the selected ruled lines for a reference ruled line, 
and then, estimates a distance between the refer- 
ence plane and the original using the reference 
ruled line. 

10 [0042] According to the present invention, it is possi- 
ble to select a ruled line string so that the distance be- 
tween the reference plane and the original is adequately 
estimated. 

[0043] The above objects of the present invention are 
is achieved by the computer readable recording media, 
wherein 

. the distance estimation step measures both a first 
distance D1 between a prolonged line of a line part in 
the reference ruled line and a curve part in the reference 
20 ruled line and a second distance D2 between an imaging 
center line and the curve part in the reference ruled line, 
and estimates a distance D between the reference plane 
and the original based on 

D = R x (D1 7D2) 

, where R is a distance between the reference plane and 
a center of a lens. 

[0044] According to the present invention, the distor- 
tion is adequately measured and the three dimensional 
shape is properly estimated. 

[0045] The above objects of the present invention are 
achieved by the computer readable recording media, 
wherein 

. the distance estimation step independently esti- 
mates each distance between the reference plane and 
the original for a left page and a right page. 
[0046] According to the present invention, in case that 
each distance between the reference plane and the orig- 
inal for a left page and a right page has different value 
because, for example, the pages near the first or last 
page of the original are copied, each distance is inde- 
pendently estimated so that the distortion for each page 
is properly corrected. 

[0047] The above objects of the present invention are 
achieved by an image distortion correction method com- 
prising steps of: 

a circumscribed rectangle extraction step for ex- 
tracting a circumscribed rectangle for each charac- 
ter in a distorted image scanned by an image read- 
ing step to read an original placed on a reference 
plane; 

a character string extraction step for extracting 
character strings using the circumscribed rectan- 
gles extracted by the circumscribed rectangle ex- 
traction step; 
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a distance estimation step for estimating a distance 
between the reference plane and the original using 
the character strings; and 

an image distortion correction step for correcting 
the distorted image based on the distance between s 
the reference plane and the original estimated by 
the image distortion correction step. 

[0048] According to the present invention, the char- 
acter strings are extracted from the scanned image read 10 
by an image reading unit. Then, a three dimensional 
shape (a distance between the reference plane and the 
original) of the original is estimated based on the char- 
acter strings and the image distortion is corrected based 
on the three dimensional shape of the original. As a re- 15 
suit, even if the whole outline of the booklet is not fully • 
captured, it is possible to sufficiently correct the distort- 
ed image with a few computational steps according to 
the present invention. 

[0049] The above objects of the present invention are 20 
achieved by an image distortion correction method com- 
prising steps of: 

a rujed line extraction step for extracting ^ 
in a distorted image scanned by an image reading 25 
unit to read an original placed on a reference plane; 
a distance estimation step for estimating a distance 
between the reference plane and the original using 
the ruled lines; and 

an image distortion correction step for correcting 30 
the distorted image based on the distance between 
the reference plane and the original estimated by 
the image distortion correction step. 

[0050] According to the present invention, the ruled 35 
lines are extracted from the scanned image read by an 
image reading unit. Then, a three dimensional shape (a 
distance between the reference plane and the original) 
of the original is estimated based on the ruled lines and 
the image distortion is corrected based on the three di- *o 
mensional shape of the original. As a result, even if the 
whole outline of the booklet is not fully captured, it is 
possible to sufficiently correct the distorted image with 
a few computational steps according to the present in- 
vention. 45 
[0051 ] The above objects of the present invention are 
achieved by an image scanner comprising: 

an image reading unit to read an original placed on 
a reference plane; and so 
an image distortion correction apparatus compris- 
ing; 

a circumscribed rectangle extraction unit which ex- 
tracts a circumscribed rectangle for each character 
in a distorted image scanned by the image reading 55 
unit; 

a character string extraction unit which extracts 
character strings using the circumscribed rectan- 



gles extracted by the circumscribed rectangle ex- 
traction unit; 

a distance estimation unit which estimates a dis- 
tance between the reference plane and the original 
using the character strings; and 
an image distortion correction unit which corrects 
the distorted image based on the distance between 
the reference plane and the original estimated by 
the image distortion correction unit. 

[0052] According to the present invention, the image 
scanner which sufficiently corrects the distorted image 
can be provided. 

[0053] The above objects of the present invention are 
achieved by an image scanner comprising: 

an image reading unit to read an original placed on 
a reference plane; and 

an image distortion correction apparatus compris- 
ing; 

a ruled line extraction unit which extracts a ruled 
lines in a distorted image scanned by the image 
reading unit; 

a distance estimation unit which estimates_a_dis- 
tance between the reference plane and the original 
using the ruled lines; and 

an image distortion correction unit which corrects 
the. distorted image based on the distance between 
the reference plane and the original estimated by 
the image distortion correction unit. 

[0054] According to the present invention, the image 
scanner which sufficiently corrects the distorted image 
can be provided. 

[0055] The above objects of the present invention are 
achieved by an image forming apparatus comprising: 

an image reading unit to. read an original placed oh 
a reference plane; 

an image distortion correction apparatus compris- 
ing; 

a circumscribed rectangle extraction unit which ex- 
tracts a circumscribed rectangle for each character 
in a distorted image scanned by the image reading 
unit; 

a character string extraction unit which extracts 
character strings using the circumscribed rectan- 
gles extracted by the circumscribed rectangle ex- 
traction unit; 

a distance estimation unit which estimates a dis- 
tance between the reference plane and the original 
using the character strings; and 
an image distortion correction unit which corrects 
the distorted image based on the distance between 
the reference plane and the original estimated by 
the image distortion correction unit; and, 
a printing unit which prints the corrected image sup- 
plied from the image distortion correction apparatus 
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on a paper. 

[0056] According to the present invention, the image 
forming apparatus which sufficiently corrects the distort- 
ed image can be provided. 

[0057] The above objects of the present invention are 
achieved by an image forming apparatus comprising: 

an image reading unit to read an original placed on 
a reference plane; 

an image distortion correction apparatus compris- 
ing; 

a ruled line extraction unit which extracts ruled lines 
in a distorted image scanned by the image reading 
unit; 

a distance estimation unit' which estimates a dis-* 
tance between the reference plane and the original 
using the ruled lines; and 

an image distortion correction unit which corrects 
the distorted image based on the distance between 
the reference plane and the original estimated by 
the image distortion correction unit; and 
a printing unit which prints the corrected image sup- 
plied from the image distortion correction apparatus 
on a paper. 

[0058] According to the present invention, the image 
forming apparatus which sufficiently corrects the distort- 
ed image can be provided. 

[0059] Other objects, features and advantages of the 
present invention will become more apparent from the 
following detailed description when read in conjunction 
with the accompanying drawings, in which: 

Fig.1 shows a sectional diagram of a scanner part 
according to an embodiment of the present inven- 
tion; 

Fig. 2 shows a perspective view of an upper part of 
an digital copy machine equipped with the scanner 
part according to an embodiment of the present in- 
vention; 

Fig.3 shows an electrical block diagram of a control 
system of the scanner part; 

Fig. 4 shows a basic block diagram of an internal 
construction of an image processing unit; 
Fig.5 shows an electrical block diagram of a main 
control unit; 

Fig:6 shows a flow chart of an image distortion cor- 
rection process for a scanned image according to 
the present invention; 

Fig.7 shows a perspective view of the scanner, on 
a contact glass of which a book type original is 
placed; 

Fig.8 shows an example of the scanned image; 
Fig.9 shows a distorted part in the vicinity of a bind- 
ing part of the book type original; 
Fig. 10 shows a histogram of black pixels in the 
scanned image as shown in Fig.8; 



Fig. 11 shows a process to extract a circumscribed 
rectangle for each character; 
Fig. 12 shows a principle of a Hough transformation; 
Fig. 13 shows an extracted line from the character 
5 string as shown in Fig. 11 using the Hough transfor- 
mation; 

Fig. 14 shows an extracted curve from the character 
string as shown in Fig. 11 using the least square 
method; 

io Fig. 15 shows a distance between the line and the 
curve of a reference character string; 
Fig. 16 shows a height between the a contact glass 
and the surface of a book type original; 
Fig. 17 shows a shrunk scanned image; 
is Fig. 18 shows an imaging of the book type original 
on an imaging plane through a scanner lens; . 
Fig. 19 shows a downward shift of a binding part irt 
the scanned image of the book type original; 
Fig.20 shows a reference character string in an orig- 
inal which is written vertically: 
Fig.21 shows an example of a ruled line in a sub 
scanning direction; 

Fig.22 shows an example of a corrected image of 
which distortion is corrected according to the 
present invention; 

Fig.23 shows the first embodiment of the selection 
of the reference character string according to the 
present invention; 

Fig.24 shows the second embodiment of the selec- 
tion of the reference character string according to 
the present invention; 

Fig.25 shows the third embodiment of the selection 
of the reference character string according to the 
present invention; 

Fig. 26 shows the fourth embodiment of the selec- 
tion of the reference character string according to 
the present invention; 

Fig.27 shows the fifth embodiment of the selection 
of the reference ruled line according to the present 
invention; 

Fig.28 shows the sixth embodiment of the selection 
of the reference ruled line according to the present 
invention; 

Fig.29 shows the seventh embodiment of the selec- 
tion of the reference ruled line according to the 
present invention; and 

Fig.30 shows the eighth embodiment of the selec- 
tion of the reference ruled line according to the 
present invention. 

[0060] Next, an embodiment according to the present 
invention will be explained with reference to Fig.1 to Fig. 
22. An image construction apparatus such as digital 
copy machine has an image distortion correction appa- 
ratus according to an embodiment of the present inven- 
tion and an image scanner is a scanner part of the digital 
copy machine. 

[0061 ] Fig. 1 shows a sectional diagram of a construc- 
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tion of a scanner part 1 . As shown in Fig.1 , the scanner 
part 1 has a contact glass 2 on which an original is 
placed, a first travelling assembly 5 having an exposure 
lamp 3 which exposes the original 1, a first reflection 
mirror 4, a second travelling assembly 8 having a sec- 
ond reflection mirror 6 and a third reflection mirror 7, an 
imaging device 9 such as a CCD (a charge coupled de- 
vice), a lens unit 1 0 which focuses the original on the 
imaging device 9, an original scale 11 which is a refer- 
ence for the original and prevents the contact glass'2 
from being detached, a white board 12 which corrects 
shading and is attached under the original scale 11 , and 
a frame 14. The CCD 9 is formed on a sensor board 13. 
[0062] The first travelling assembly 5 and the second 
travelling assembly 8 are driven by a stepping motor 24 
(refer to Fig.3) in the sub scanning direction when the 
original is scanned. The first travelling assembly 5 and 
the second travelling assembly 8 carry the exposure 
lamp 3 under the contact glass 2 and the original is ex- 
posed to light, The reflected light from the original 1 is 
reflected by the first reflection mirror 4, the second re- 
flection mirror 6 and the third reflection mirror 7 and then, 
is focused on the CCD 9 through the lens unit 1 0. 
[0063] The scan ner p art 1 is provided to the digital 
copy machine 16 which has a printer part (not shown) 
as an image forming apparatus that forms an image on 
a paper using a electro photograph method according 
to the image data. Fig.2 shows a perspective view of an 
upper part of the digital copy machine 1 6 equipped with 
the scanner part 1 . As shown in Fig.2, an original cover 
1 7 which can be opened and closed against the contact 
glass 2 and an open'and close sensor 1 8 of the original 
cover 17 are provided to the scanner part 1 . Alternative 
printers which employ various kinds of printing method, 
such as an electro photograph method, an ink jet meth- 
od, a dye sublimation thermoelectric method, a silver 
bromide photograph method, a direct thermal recording 
method and a melting thermoelectric method as well as 
the electro photograph method can be provided to the 
digital copy machine 16 as the printer. Explanations of 
these methods are omitted because these methods are 
well known to those who are skilled in the art. 
[0064] Fig.3 shows an electrical block diagram of a 
control system of the scanner part 1 . In this control sys- 
tem, a main control unit 19 is connected to an image 
processing unit 20, a travelling assembly control unit 21 , 
an operation panel 22 and a memory 23. The main con- 
trol unit 1 9 controls the whole of the scanner 1 . The im- 
age processing unit 20 processes image data captured 
by the CCD 9. The travelling assembly control unit 21 
controls the first travelling assembly 5 and the second 
travelling assembly 8. The operation panel 22 receives 
commands supplied to the digital copy machine 1 6 and 
displays various kinds of messages, The memory 23 
stores the image data captured by the CCD 9 and other 
predetermined data. On the operation panel 22, keys 
such as a copy start key which initiates copying, and so 
on are provided. The travelling assembly control unit 21 



is connected to the exposure lamp 3, the stepping motor 
24 which drives the first travelling assembly 5 and the 
second travelling assembly 8, a scanner home position 
sensor (an HP sensor) 25 which detects that the first 
* travelling assembly 5 and the second travelling assem- 
bly 8 are placed at the home position and the open and 
close sensor 18. 

[0065] Fig.4 shows a basic block diagram of an inter- 
nal construction of the image processing unit 20. As 

10 shown in Fig.4, the image processing unit 20 has an an- 
alog video processing unit 26, a shading correction 
processing unit 27 for the shading correction, an image 
data processing unit 28 and an image distortion correc- 
tion unit 29. The analog video processing unit 26 ampli- 

15 fies the image signal captured by the CCD 9 and con- 
verts the captured analog image into a digital image. 
The image data processing unit 28 performs an MTF 
correction, a scaling process and a y correction to the 
shading corrected digital image and produces a 

20 scanned image. The image distortion correction unit 29 
performs a distortion correction for the distorted image, 
which is a characteristic feature of the present invention. 
The image processed digital image is supplied to the 
printer pari through the'main control unit 19 and then-is - 

25 printed out. 

[0066] Fig.5 shows an electrical block diagram of the 
main control unit 1 9. As shown in Fig.5, the main control 
unit 19 has a CPU (central processing unit) 31 which 
centrally controls components connected to it. This CPU. 

30 31 is connected to a ROM (readonly memory) 32 which 
stores BIOS, and so on, a RAM (random access mem- 
ory) 33 which serves as a work area for the CPU 31 , 
and a bus 34. These components compose a micro 
computer. Further, the bus 34 is connected to a HDD 

35 which stores a control program, a CD-ROM (Compact 
Disc) drive 36 which reads a CD-ROM 37 and an inter- 
face (l/F) 38 through which the CPU 31 communicates 
with the printer part. 

[0067] The CD-ROM 37 as shown in Fig.5 is one of 

40 the recording media of the present invention and stores 
a predetermined control program. The CPU 31 reads 
the control program stored on the CD-ROM 37 through 
the CD-ROM drive 36 and theh installs it to the HDD 35. 
This program enables the main control unit 19 to per- 

45 form various processes which are described later. 

[0068] Further, it is possible to use various kinds of 
optical discs such as DVD's, various kinds of magnet- 
optical discs, various kinds of magnet discs such as flop- 
py discs, various kinds of semiconductor memories, and 

so so on, as well as the CD-ROM 37 as the recording me- 
dia. It is also possible to install the program, which is 
downloaded through networks such as the Internet, to 
the HDD 35. In this case, the recording media which 
store the programs on a server side are also the record- 

55 jng media according to the present invention. The pro- 
gram may be executed under a predetermined OS (Op- 
erating System) or the OS may execute a part of the 
processes in the program, as described later. Further, 
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the program may be included in a group of program files 
which construct application programs such as word 
processing software and an operating system, and so 
on. 

[0069] Processes which are executed by the CPU 31 
provided in the main control unit 1 9 under the control of 
the control program, will be explained. First of all, a dis- 
tortion correction process for a scanned image executed 
by the image distortion correction unit 29 will be ex- 
plained. This process corrects the scanned and distort- 
ed image and is a characteristic function of the scanner 
part 1 according to the present invention. 
[0070] . Fig. 6 shows a schematic flow chart of the dis- 
tortion correction process for the scanned image ac- 
cording to the present invention. Fig. 7 shows a perspec- 
tive view of the scanner part, on a contact glass of which 
a book type original 40 is placed. The binding part 41 of 
the book type original 40 is placed on the contact glass 
2 in parallel to a main scanning direction of the scanner 
part 1. 

[0071] First, at a step S1, the scanned image of the 
book type original 40 oh the contact glass 2. output from 
the image data processing unit 28 is supplied to the im- 
age distortion correction unit 29. Fig.8 shows an exam- 
ple ofthe scanned image. Fig. 9 shows a distorted part 
in the vicinity of a binding part 41 of the book type original 
40. As shown in Fig. 9, the scanned image has the dis- 
tortion part in the vicinity of the binding part 41 . 
[0072] Next, at a step S2, the scanned image of the 
book type original 40, for example, a gray scale image, 
is optimally converted into a binary image. Then 5 at a 
step S3, a histogram of a number of black pixels in the 
sub scanning direction is calculated. The black pixel is 
a pixel with higher density than a predetermined density. 
Fig. 10 shows a histogram of the black pixels in the 
scanned image as shown in Fig.8. A horizontal axis in 
Fig. 10 shows a position of the black pixel in the sub 
scanning direction, and a vertical axis in Fig.10 shows 
the number of the black pixels. 

[0073] Next, at a step S4, the process waits until an 
instruction is received, which shows whether the image 
distortion correction process is performed based on 
character information or ruled line information. 
[0074] If the instruction received shows that the char- 
acter information is used for the image distortion correc- 
tion process (N at the step 4), then the process advanc- 
es to a step 5. In the step 5, it is determined whether the 
characters in the book type original are written vertically 
or horizontally. This determination is done based on the 
histogram of the number of the black pixels in the sub 
scanning direction calculated in the step 3. For example, 
if the original is written in the horizontal as shown in Fig. 
8, there exists a repetition pattern of peaks. On the other 
hand, in case of that the original is written in the vertical, 
there is no repetition pattern of the peaks. This charac- 
teristic enables to decide whether an original is written 
in horizontally or vertically, 

[0075] If the scanned image is a color gray scale im- 



age, the conversion ofthe scanned image into the binary 
image is performed using one component among R 
(red), G (green) and B (blue) components, for example, 
the G component. In this case, the black pixel is a pixel 

5 of the G component with higher density than a prede- 
termined density of the G component and the white pixel 
is a pixel of the G component with lower density than a 
predetermined density of the G component. It'is also 
possible to decompose the RGB image into a luminance 

10 component and a chrominance component, and then 
the luminance component can be used to convert the 
scanned image into the binary image, as mentioned 
above. 

[0076] In case that the original is written in the hori- 
15 zontal (Y at the step S5), a character string extraction 
process extracts a circumscribed rectangle for each 
character, which is a series of the black pixels, at a step 
6. Then, at a step 7, a plurality of character strings are 
extracted and an optimal reference character string is 
20 selected among the character strings. An explanation of 
the character recognition process is omitted because it 
is well known. Fig,11 shows an example of a result of 
the string extraction process to extract a circumscribed 
rectangle for each character and the selected optimal 
25 character string. The optimal character string is a string 
which has a length longer than a predetermined length 
and has the largest curvature among the plurality of 
character strings. For example, the string which has the 
length longer than the predetermined length is a string 
30 having a length longer than 80 % of the longest string. 
An optimal character string is selected for each side of 
a border of the binding part 41 of the book type original 
40. The curvature is measured based on a location of 
the center coordinates in the main scanning direction of 
35 the circumscribed rectangle in the character string. The 
larger a difference between the maximum value of the 
center coordinates and the minimum value of the center 
coordinates, the larger is the curvature. 
[0077] Next, at a step S8, a line portion in the optimal 
40 reference character string selected at the step S7 is ex- 
tracted. The extraction of the line portion in the optimal 
reference character string is performed using a Hough 
transformation of the center coordinates of each circum- 
scribed rectangle. 
45 [0078] A principal of the Hough transformation will be 
explained. Fig. 12 shows the principle of a Hough trans- 
formation. A line on a point P(x, y) satisfies the equation 
(1) as follows. 

50 

p = x • cos 8 +y • sin 6 (1) 

where (x, y) are the coordinates of the point P and p is 
a distance between the origin and the point P. 6 is an 
55 angle between a line segment PO and the.x-axis. The 
center coordinates (xi, yi) ofthe rectangle are projected 
to (p, 6) a discrete (meshed) parameter plane, A point 
(x, y) is projected to one curve on the (p,9) plane. A count 
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value for each mesh on the curve is incremented. If there 
is a point having a large count value on the (p, 6) plane, 
there exists a corresponding line on the (x, y) plane. 
Therefore, the line on the (x, y) plane can be extracted 
by means of finding a point having the largest count val- s 
ue on the (p,6) plane because there is only one line for 
each character string. This method is robust against a 
noise and, it is possible to extract a line even if a line 
and a curve co-exist. Fig. 13 shows an extracted line 
from the character string as shown in Fig.11 using the 10 
Hough transformation. 

[0079] Next, at a step S9, a curve part in the reference 
character string is extracted. The selected reference 
character string at the step S7 is approximated by a pol- 
ynomial (2) and coefficients of the polynomial are cal- 15 
culated using the least square method. That is to say, 
the step S9 calculates an approximated curve for the 
selected reference character string. 

12 n 20 

Y=a 0 +a 1 x + a 2 x + • • • + a n x (2) 

.where (x, y) are the center coordinates of the circum- 
scribed rectangle and (a 0; a 1? a 2 - • - a n ).are_the„coeffj- 

cients of the polynominal, Fig. 14 shows an extracted 25 
curve from the character string as shown in Fig.11 using 
the least square method. 

[0080] Next, at a step S10, a distance between the 
line calculated at the step S8 and the curve calculated 
at the step S9 is measured. Then a three dimensional 30 
shape recovery is performed at a step S11. Fig. 15 
shows the distance between the line and the curve in a 
reference character string. 

[0081] In case that the binding part 41 of the book type 
original 40 is placed on the contact glass 2 in parallel to 35 
a main scanning direction of the scanner part 1, the 
characteristics of the image formation system are as fol- 
lows when the lens unit 1 0 is used to read the book type 
original 40. The image formation system uses a center 
projection in the main scanning direction and it uses a <o 
plain projection in the sub scanning direction. The three 
dimensional shape recovery uses these characteristics. 
Fig. 16 shows a height between the a contact glass 2 
and the surface of a book type original. Fig. 17 shows a 
shrunk scanned image. As shown in Fig.1 6 and Fig. 1 7, 45 
in a case of center projection, the greater the distance 
d between the contact glass 2 and the surface of a book 
type original 40 becomes, the lower the magnification of 
the image becomes. Therefore, upper and lower lines 
of an outline of the scanned image of the book type orig- so 
inal 40 are curved to the inside as shown in Fig.1 7. This, 
means that it is possible to calculate a height d based 
on a measured value of the distance AB. As a result, it 
is possible to recover the three dimensional shape, that 
is to say, the distance d between the contact glass 2 and 55 
the surface of a book type original 40, based on the 
measured value of the distance AB. 



[0082] It is assumed that the book type original 40 is 
placed horizontally on the contact glass 2. Then, the 
three dimensional shape is observed as a two dimen- 
sional shape. Fig. 18 shows an imaging of the book type 
original 40 on an imaging plane through a scanner lens. 
A reference OO 1 shows an optical axis and a reference 
O shows a center of the lens. A reference F shows a 
distance between the contact glass 2 as a reference 
plane of the scanner and the center of the lens O and 
this distance is called a focal length of the scanner. A 
point B on the reference plane of the scanner forms an 
image D on the imaging plane. A point C on the book 
type original 40 separated from the reference plane of 
the scanner forms an image E on the imaging plane. A 
distances between the point E and the center O is y and 
a distances between the point D and the center O.is y\ 
It is noted that the center of the lens is moved when the 
first travelling assembly 5 and the second travelling as- 
sembly 8 are moved in the sub scanning direction. We 
call the trace of the center of the lens an imaging center 
line. Relation among d, F, AB, AO', y and y' satisfy fol- 
lowing equations (3) and (4) using the similar triangles. 

d/F^AB/AO' (3) 

AB/AO'^y'-yyy (4) 

[0083] A distance d is obtained from the equations (3) 
and (4) based on a following equation (5). 

d=F x ((y'-y)/y) (5) 

[0084] The three dimensional shape can be obtained 
from the equation (5) based on the value (y* - y) which 
shows a two dimensional distortion value. In this em- 
bodiment, the dimensional distortion value (y' - y) and 
the distance y are obtained from the line part and curve 
part extracted from the reference character string as 
mentioned above or the ruled line. The focal length F is 
fixed to the scanner part 1 and is known value. A set 
value of the scanner part 1 or a calibrated value for the 
lens is used for the focal length F. The distance between 
the reference plane of the scanner and the surface of 
the book type original 40 is determined by means of the 
steps S8 to S11 as mentioned above. 
[0085] Next, at a step S12, a distortion correction of 
the scanned image is performed based on the three di- 
mensional shape determined by the above steps. Then, 
at a step S13, the luminance of the corrected image is 
corrected. Fig.1 9 shows a downward shift of a binding 
part in the scanned image of the book type original. The 
scanned image is shifted, row by row, downward in par- 
allel to the binding part of the book original until the lower 
edge of the scanned image becomes straight. Then, a 
reduction ratio is calculated based on a distance be- 
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tween a dotted straight line and an upper curve edge of 
the scanned image and the scaling process is per- 
formed to the scanned image. Further, the scanned im- 
age is expanded in the sub scanning direction. Further, 
the luminance correction is performed for each pixel in 
each column based on the whitest pixel in the column. 
More details are described in the laid-open Japanese 
patent application number 11-41455. The image distor- 
tion correction is performed by means of the steps S12 
and S13 mentioned above. 

[0086] Next, another embodiment of the present in- 
vention will be explained. Fig.20 shows a reference 
character string in a case that an original is written in 
vertically, When it is determined that the character string 
in the original is written in the vertical at the step S5 (N), 
an extraction process of the circumscribed rectangle 
and an extraction process of the character string written 
vertically are performed at a step S14. A circumscribed 
rectangle at a top of or at a bottom of each vertical line 
is extracted and a reference character string is deter- 
mined based on the circumscribed rectangles. Then, the 
envelope of the vertical lines is extracted based on the 
reference character string. 

[0087] Next, at the step SB to S1 3, the image distor- 
tion correction process is performed using the center co- 
ordinates of each circumscribed rectangle in the refer- 
ence character string as mentioned above. 
[0088] it is also possible to use ruled lines in the sub 
scanning direction to perform the image distortion cor- 
rection process when the indication to select ruled line 
information is supplied at the step S4 (Y). At a step S15, 
the ruled line in the sub scanning direction is extracted. 
Fig.21 shows an example of a ruled line in the sub scan- 
ning direction. The histogram of the black pixels In the 
sub scanning direction calculated at the step S3 is used 
at the step S15. AS shown in Fig.21, when there are 
ruled lines in the scanned image, the histogram has nar- 
row peaks. Therefore, the peaks are used to extract the 
ruled lines. The lines each of which has a length longer 
than a predetermined length are selected. For example, 
the ruled lines which have the length longerthan the pre- 
determined length are ruled lines having a length longer 
than 80 % of the longest ruled line. Then, one line near- 
est the upper or lower edge of the scanned image is se- 
lected as a reference ruled line. The reference ruled line 
is selected for each side of a border of the binding part 
41 of the book type original 40. Then, the same steps 
S8 to S13 as mentioned above follow the step 15. 
[0089] Fig.22 shows an example of a corrected image 
of which distortion is corrected according to the embod- 
iment of the present invention. As shown in Fig.22, the 
distortion in the vicinity of the binding part 41 of the book 
type original 40 as shown in Fig.8 is corrected. 
[0090] Next, the embodiments for selection of the ref- 
erence character string will be explained. 
[0091 ] Fig. 23 shows the first embodiment of the se- 
lection of the reference character string according to the 
present invention. In this embodiment, first, strings each 



of which has a length longer than a length of a prede- 
termined ratio to that of the longest string are selected 
out of a plurality of character strings. Then, one string 
having the largest curvature out of the selected charac- 
5 ter strings is selected for the reference character string. 
[0092] Fig.24 shows the second embodiment of the 
selection of the reference character string according to 
the present invention. In this embodiment, first, strings 
each of which has a length longerthan a length of a pre- 
io determined ratio to that of the longest string are selected 
out of a plurality of character strings. Then, one string 
placed nearest the upper edge of the scanned image 
out of the selected character strings is selected for the 
reference character string. 
15 [0093] Fig.25 shows the third embodiment of the se- 
lection of the reference character string according to the 
present invention. In this embodiment, first, strings each 
of which has a length longer than a length of a prede- 
termined ratio to that of the longest string are selected 
out of a plurality of character strings. Then, one string 
placed nearest the lower edge of the scanned image out 
of the selected character strings is selected for the ref- 
erence character string. 

[0094] Fig.26 shows the fourth embodiment of the se- 
lection of the reference character string according to the 
present invention. In this embodiment, first, strings each 
of which has a length longer than a length of a prede- 
termined ratio to that of the longest string are selected 
out of a plurality of character strings. Then, one string 
placed nearest the binding part of a book type original 
out of the selected character strings is selected for the 
reference character string. 

[0095] Next, the embodiments for selection of the ref- 
erence ruled line will be explained. 
[0096] Fig.27 shows the fifth embodiment of the se- 
lection of the reference ruled line according to the 
present invention, in this embodiment, first, ruled lines 
each of which has a length longer than a length of a pre- 
determined ratio to that of the longest ruled line are se- 
lected out of a plurality of ruled lines. Then, one ruled 
line having the largest curvature out of the selected ruled 
lines is selected for the reference ruled line. 
[0097] Fig. 28 shows the sixth embodiment of the se- 
lection of the reference ruled line according to the 
present invention. In this embodiment, first, ruled lines 
each of which has a length longer than a length of a pre- 
determined ratio to that of the longest ruled line are se- 
lected out of a plurality of ruled lines. Then, one ruled 
line placed nearest the upper edge of the scanned im- 
age out of the selected ruled lines is selected for the 
reference ruled line. 

[0098] Fig.29 shows the seventh embodiment of the 
selection of the reference ruled line according to the 
present invention. In this embodiment, first, ruled lines 
each of which has a length longer than a length of a pre- 
determined ratio to that of the longest ruled line are se- 
lected out of a plurality of ruled lines. Then, one ruled 
line placed nearest the lower edge of the scanned image 
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out of the selected ruled lines is selected for the refer- 
ence ruled line. 

[0099] Fig.30 shows the eighth embodiment of the se- 
lection of the reference ruled line according to the 
present invention. In this embodiment, first, ruled lines s 
each of which has a length longer than a length of a pre- 
determined ratio to that of the longest ruled line are se- 
lected out of a plurality of ruled lines. Then, one ruled 
line placed nearest the binding part of a book type orig- 
inal out of the selected ruled lines is selected for the ref- 10 
erence ruled line. 

[0100] in the foregoing specification, the invention 
has been described with reference to specific embodi- 
ments in which the image distortion correction unit is 
provided in the digital copy machine 16 as the digital 15 
image forming apparatus and an distorted image 
scanned by the scanner part 1 is corrected. However, it 
should be noted that the present invention is not limited 
to these embodiments. It will be evident that various 
modifications and changes may be made without de- 20 
parting from the spirit and scope of the invention. For 
example, an image scanner which has an image reading 
means for an original may be connected to a personal 

computer and t he personal computer loads a progr am 

stored on the CD-ROM 37 into the HDD in the personal 25 
computer. This construction achieves an image distor- 
tion correction unit which operate as mentioned above. 
It is also possible to correct the distorted image, which 
has been already scanned by another scanner, by 
means of the personal computer of which the program 30 
stored on the CD-ROM 37 is loaded into the HDD. 
[01 01 ] The present application is based on Japanese 
priority application No. 2000-379895 filed on December 
14, 2000, Japanese priority application No. 
2001-101279 filed on March 30, 2001, and Japanese 35 
priority application No. 200 1-374490 filed on December 
07, 2001 , the entire contents of which are hereby incor- 
porated by reference. 



Claims 

1 . An image distortion correction apparatus compris- 
ing: 

45 

a circumscribed rectangle extraction unit for ex- 
tracting a circumscribed rectangle for each 
character in a distorted image scanned by an 
image reading unit to read an original placed 
on a reference plane; so 
a character string extraction unit for extracting 
character strings using said circumscribed rec- 
tangles extracted by said circumscribed rectan- 
gle extraction unit; 
. a distance estimation unit for estimating a dis- 55 
tance between said reference plane and said 
original using said character strings; and 
an image distortion correction unit for correct- 



ing said distorted image based on said distance 
between said reference plane and said original 
estimated by said image distortion correction 
unit. 

2. An image correction apparatus as claimed in claim 
1 , further comprising: 

an original distinction unit for deciding whether 
said original is written horizontally or vertically, 
wherein in the case that said horizontal distinc- 
tion unit decides that said original is written in 
the horizontal, 

said distance estimation unit first selects char- 
acter strings each of which has a length longer 
than a length of a predetermined ratio to that of 
the longest string out of a plurality of character 
strings in said distorted image, then selects one 
string having the largest curvature out of said 
selected character strings for a reference char- 
acter string, and then estimates a distance be- 
tween said reference plane and said original 
using said reference string. 



3. An image distortion correction apparatus as 
claimed in claim 2, wherein said curvature is meas- 
ured based on the location of the center coordinates 
in a main scanning direction of the circumscribed 
rectangle in the character string, and the larger a 
difference between a maximum value of said center 
coordinates and a minimum value of said center co- 
ordinates, the larger is the said curvature. 

4. An image distortion correction apparatus as 
claimed in claim 1 , 2 or 3, further comprising: 

an original distinction unit for deciding whether 
said original is written horizontally or vertically, 
wherein in the case that said original distinction 
Unit decides that said original is written in the 
vertical, 

said character string extraction unit extracts a 
reference character string using circumscribed 
rectangles either at a top of or at a bottom of 
each vertical line, and 

said distance estimation unit estimates a dis- 
tance between said reference plane and said 
original using said reference string. 

5. The image distortion correction apparatus as 
claimed in claim 2, 3 or 4, characterized in that 

said distance estimation unit measures both 
a first distance D1 between an extended line of a 
line part in said reference character string and a 
curve part in said reference character string and a 
second distance D2 between an imaging center line 
and said curve part in said reference character 
string, and estimates a distance D between said ref- 
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erence plane and said original based on 

D=RX(D1/D2), 

where R is a distance between said reference plane 
and a center of a lens. 

6. An image distortion correction apparatus compris- 
ing: 

a ruled line extraction unit for extracting ruled 
lines in a distorted image scanned by an image 
reading unit to read an original placed on a ref- 
erence plane; 

a distance estimation unit for estimating a dis- 
tance between said reference plane and said 
original using said ruled lines; and 
an image distortion correction unit for correct- 
ing said distorted image based on said distance 
between said reference plane and said original 
estimated by said image distortion correction 
unit. 

7. An image distortion correction apparatus as 
claimed in claim 6 further comprising: 

an original distinction unit for deciding whether 
said original is written horizontally or vertically, 
wherein in the case that said original distinction 
unit decides that said original is written in the 
horizontal, 

said distance estimation unit first selects ruled 
lines each of which has a length longer than a 
length of a predetermined ratio to that of the 
longest ruled line out of a plurality of ruled lines 
in said distorted image, then selects one ruled 
line placed nearest an upper edge or a lower 
edge of the scanned image out of said selected 
ruled lines for a reference ruled line, and then 
estimates a distance between said reference 
plane and said original using said reference 
ruled line. 

8. An image distortion correction apparatus as 
claimed in claim 7, wherein 

said distance estimation unit measures both 
a first distance D1 between an extended line of a 
line part in said reference ruled line and a curve part 
in said reference ruled line and a second distance 
D2 between an imaging center line and said curve 
part in said reference ruled line, and estimates a dis- 
tance D between said reference plane and said 
original based on 

D = RX(D1 / D2). 



where R is a distance between said reference plane 
and a center of a lens. 

9. An image distortion correction apparatus as 
5 claimed In claim 6, wherein 

said distance estimation unit independently 
estimates each distance between said reference 
plane and said original for a left page and a right 
page. 

10 

10. An image distortion correction method comprising 
the steps of: 

a circumscribed rectangle extraction step for 
extracting a circumscribed rectangle for each 
character in a distorted image scanned by an 
image character in a distorted image scanned 
by an image reading step to read an original 
placed on a reference plane; 
a character string extraction step for extracting 
character strings using said circumscribed rec- 
tangles extracted by said circumscribed rectan- 
gle extraction step; 

a distance estimation step for estimating a dis- 
tance between said reference plane and said 
original using said character strings; and 
an image distortion correction step for correct- 
ing said distorted image based on said distance 
between said reference plane and said original 
estimated by said image distortion correction 
step. 

11. A method according to claim 10, further comprising: 

an original distinction step which decides 
whether said original is written horizontally or 
vertically, wherein in the case that said original 
distinction step decides that said original is writ- 
ten in the horizontal, 

said distance estimation step first, selects char- 
acter strings each of which has a length longer 
than a length of a predetermined ratio to that of 
the longest string out of a plurality of character 
strings in said distorted image, then selects one 
string having the largest curvature out of said 
selected character strings for a reference char- 
acter string, and then estimates a distance be- 
tween said reference plane and said original 
using said reference string. 

12. A method according to claim 1 1 , wherein said cur- 
vature is measured based on a location of center 
coordinates in a main scanning direction of the cir- 
cumscribed rectangle in the character string, and 
the larger a difference between a maximum value 
of said center coordinates and a minimum value of 
said center coordinates, the larger is the said cur- 
vature. 



25 



30 



35 



40 



45 



50 



13 



25 



EP1 215 881 A1 



26 



13. A method according to claim 10, 11 or 12, further 
comprising: 

an original distinction step for deciding whether 
said original is written horizontally or vertical^ s 
wherein in the case that said original distinction 
step decides that said original is written in the 
vertical, 

said character string extraction step extracts a 
reference character string using circumscribed n> 
rectangles either at a top of or at a bottom of 
each vertical line, and 

said distance estimation step estimates a dis- 
tance between said reference plane and said 
original using said reference string. 15 

14. A method according to any one of claims 11 to 13, 
wherein 

said distance estimation step measures both 
a first distance D1 between an extended line of a 20 
line part in said reference character string and a 
curve part in said reference character string and a 
second distance D2 between an imaging center line 
and said curve part in said reference character 
string, and estimates a distance D between said ref- 25 
erence plane and said original based on 

D=RX(D1/D2), 

30 

where R is a distance between said reference plane 
and a center of a lens. 

15. An image distortion correction method comprising 
the steps of: 35 

a ruled line extraction step for extracting ruled 
lines in a distorted image scanned by an image 
reading unit to read an original placed on a ref- 
erence plane; 40 
a distance estimation step for estimating a dis- 
tance between said reference plane and said 
original using said ruled lines; and 
an image distortion correction step for correct- 
ing said distorted image based on said distance 45 
between said reference plane and said original 
estimated by said image distortion correction 
step. 

16. A method according to claim 15, further comprising: so 

an original distinction step for deciding whether 
said original is written horizontally or vertically, 
wherein in thecase that said original distinction 
step decides that said original is written in the 55 
horizontal, 

said distance estimation step first, selects ruled 
lines each of which has a length longer than a 



length of a predetermined ratio to that of the 
longest ruled line out of a plurality of ruled lines 
in said distorted image, then selects one ruled 
line placed nearest an upper edge or a lower 
edge of the scanned image out of said selected 
ruled lines for a reference ruled line, and then 
estimates a distance between said reference 
plane and said original using said reference 
ruled line. 

1 7. A method according to claim 1 6, wherein: 

said distance estimation step measures both a 
first distance D1 between an extended line of a 
line part in said reference ruled line and a curve 
part in said reference ruled line and a second 
distance D2 between an imaging center line 
and said curve part in said reference ruled line, 
and estimates a distance D between said ref- 
erence plane and said original based on 

D = R X (D1 / D2), 

where R is a distance between said reference 
plane and a center of a lens. 

18. A method according to any one of claims 10 to 17, 
wherein: 

said distance estimation step independently 
estimates each distance between said refer- 
ence plane and said original for a left page and 
a right page. 

19. A computer program comprising code means to in- 
struct a data processing device to execute an image 
distortion correction method, according to any one 
of claims 10 to 18. 

20. An image scanner comprising: 

an image reading unit to read an original placed 
on a reference plane; and 
an image distortion correction apparatus ac- 
cording to any one of claims 1 to 9. 

21; An image forming apparatus according to claim 20 
further comprising: 

a printing unit which prints said corrected image 
supplied from said image distortion correction 
apparatus on a paper. 
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